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ABSTRACT 

A study was conducted to determine if a 
teacher-constructed cloze procedure correlated significantly with two 
standardized tests of reading achievement, thereby testing G.D. 
Spache's claim that most teachers are unable to design valid and 
reliable assessment materials. Subjects were 60 fourth and sixth 
grade students who were administered the Nelson-Reading Test, the 
reading subtests of the SRA achievement series, and a 
teacher-constructed cloze procedure testing student independent, 
instructional, and frustration levels. Multiple regression analysis 
indicated high statistical correlations between selected levels of 
cloze procedure and standardized test scores. Significant 
correlations were obtained among the three levels of cloze procedure, 
and no single variable was found to be a good predictor of reading 
achievement. Many combinations of variables in the prediction models, 
however, were found to be highly significant predictors of the 
Nelson-Reading Test scores. The results suggest that the teacher-made 
cloze procedures were appropriately leveled and shaped, casting doubt 
on Spache's claim. (Master list scores for cloze procedure levels are 
appended. ) (FL) 
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ABSTRACT 



This study was conducted to determine whether or 
not teachers could develop appropriately leveled and 
shaped cloze procedures that would be significantly 
correlated to standardized reading tests. The subjects for 
this study were sixty fourth and sixth grade students. The 
variables in this study were The Nelson-Reading Test , SRA 
Reading Subtest and the cloze procedure independent level, 
instructional level, and f rustrational level. The cloze 
procedures were teacher-constructed for the use of this 
study and developed based on the traditional cloze 
standards. The data were analyzed using Pearson product- 
moment correlation technique and a multiple regression 
analysis formula. 

The statistical analyses conducted indicated that 
there were high statistical correlations between selected 
levels of cloze procedure and standardized test scores. 
Educationally significant correlations were obtained among 
the three levels of cloze procedure and no single variable 
was found to be a good predictor of reading achievement . 
However, many combinations of variables in the prediction 
models were found to be highly significant predictors of 
The Nelson-Reading Test scores. 
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Chapter 1 
INTRODUCTION TO THE STUDY 
Introduction 

Classroom teachers who strive to maintain classroom 
practices in keeping with current research in teaching 
reading are constantly faced with many problems. One of 
these problems is related to determining and periodically 
monitoring students' reading levels, the readability of 
reading materials and students 1 comprehension levels. Pre- 
sently, the time required to administer such recommended 
assessments on a regular basis is sometimes considered far 
too time consuming and may cause teachers to teach less in 
reading which may be a major reason why a large number of 
teachers do not attend to that responsibility (Herber , 
1970). Subsequently, the effect of lack of evaluation 
could result in an ineffective reading program. Addition- 
ally, if lack of time for assessment is a true and 
reasonable reason for not assessing , then recommendations 
based on research findings may not be as practical as they 
may seem for teachers . 

Another assessment-related problem exists in 
teachers bei ng able to determine which assessment device 
and methods to use in determining students' reading levels, 
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the readability of reading materials, and students 1 compre- 
hension . levels , Currently , the commercial market is 
flooded with standardized and non-standardized reading 
tests and reading inventories that may be used to measure 
reading ability and reading skills. Yet, Pikulski (1974) 
warned teachers that few assessment materials can be truly- 
useful to classroom teachers if the assessment materials 
are not directly related to the teachers' classroom reading 
materials; that is, the assessment devices may not be sig- 
nificantly correlated to or may not serve as reputable pre- 
dictors of reading ability of a given group of students in 
assigned classroom materials. 

The problem that appears to exist is that of the 
classroom teachers' dilemma in determining and periodically 
monitoring students 1 reading levels, the readability of 
reading materials, and students' comprehension levels. Can 
theory and recommendations from noted reading authorities 
become practical for teachers? 

Cloze procedure may be one answer to the classroom 
teachers 1 dilemma. Cloze procedure has been cited as useful 
in determining students 1 reading levels, the readability of 
reading materials, assessing students' comprehension 
levels, and for improving other reading and language abili- 
ties (Kingston, 1977; Pikulski & Shanahan, 1982). Cloze 
procedures have also been cited as easy to design, easy to 
evaluate, and easy to administer as a result of their 
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applicability to either a group or an individual (Cunning- 
ham, Cunningham, & Arthur, 1981) . However, cloze procedures 
need to be shown as statistically valid and reliable before 
they can be considered as useful devi ces for classroom 
teachers. Therefore, the intent of this investigator was 
to determine if a teacher- const rue ted cloze procedure was 
statistically significantly correlated to two standardized 
tests of reading achievement . Another intent of this 
investigator was to provide inf ormati on to possibly confirm 
or reject Spache's idea that the majority of teachers are 
unable to design and shape assessment materials that are 
valid and reliable. 

Statement of the Problem 

The problem identified for the purpose of this 
study was whether or not teachers could develop appropri- 
ately leveled and shaped cloze procedures that would be 
significantly correlated to standardized reading tests. 
The questions to be answered as a result of the study 
appear below. 

Questions to be Answered 

The following questions were answered through the 
testing of the hypotheses that were generated. 

1. What differences existed among grade levels of 
reading comprehension as obtained through using standardized 



tests and those of three levels (independent, instructional, 
and f rust rational ) of cloze procedure proficiency * 

2. What degree of relationship existed among the 
two standardized reading comprehension tests variables and 
those of the three levels of the cloz e procedure 
proficiency? 

3 . Using two selected standardized reading tests 
as the dependent variables , what independent or weighted 
combinations of independent variables were the best pre- 
dictors of the standardized reading tests when the data 
were subjected to multiple regression analysis? 

Hypotheses 

To investigate the problem and answer the questions 
just stated, the following hypotheses were generated. 

1 . There will be significant positive correlations 
between reading levels obtained from the Nelson-Ri a uing 
Test ( NRT /Comprehension/) and SRA Achievement Series Read- 
ing subtest ( SRA /Reading/) and the three reading levels 
(independent, instructional, f rustrational) of cloze pro- 
cedure proficiency . 

2 . There will be positive , sign If icant correla- 
tions between selected weighted combinations of several 
independent variables , including cloze procedure profi- 
ciency levels and standardized reading tests when data are 
subjected to multiple correlational analysis. 
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Purpose of the Study 

The purpose for conducting the study herein was to 
determine the educational value of a specific teacher- 
constructed cloze procedure. It was thought that if the 
test were validated, then classroom teachers would be able 
to follow current research practices recommended by author- 
ities in reading; that is, teachers' dilemma of determining 
and periodically monitoring students 1 reading levels, the 
readability of reading materials, and students 1 comprehen- 
sion levels could possibly be solved by the use of cloze 
procedure . 

Another purpose of this study was to add to the 
existing information related to correlational studies among 
the cloze procedure and other evaluative measures to pro- 
vide information concerning teachers 1 abilities to design 
and shape valid reading assessment materials so that 
students may be provided more appropriate reading materials. 

Significance of the Study 

The nature and purpose of this study is significant 
for several reasons. First, teachers need a quick and 
effective way to determine if students can effectively read 
and comprehend materials in the classroom. Secondly, 
teachers need a valid instrument to assess students 1 read- 
ing and comprehension levels. Thirdly, the assessment 
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device needs to be designed based on classroom reading 
levels. Finally, the assessment device needs to be easy to 
design . In summary , cloze procedure , i f found to be a 
valid assessment instrument, could possibly enable teachers 
to monitor student progress in reading so that more preci se 
reading instructi on strategies could be designed to meet 
the needs of the students - 

De 1 imi tati ons 

This study was limited in the following respects. 
1 - The study was limited to those students who 
were enrolled at a university laboratory school - 

2. The study was limited to fourth and sixth grade 
students at the university laboratory school. 

3. Students were selected who appeared to be able 
to read grade level materials comfortably according to 
their teachers 1 judgment. 

4. Only students who had not repeated a grade or 
grades wc^re used in the study. 

Def ini ti ons of Terms 

To help facilitate the understanding of this study, 
the following terms have prescribed definitions. 

1 . Reading Comprehension —reading comprehension is 
a complex process involving high-level cognitive skills 
through passive and active mental processes in which the 

-• 14 
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reader uses general and specific background knwoledge to 
interpret and relate to the pattern of printed words 
written by the writer (Harris & Sipay, 1979). 

2. Cloze Procedure - -a procedure where the reader 
is given a passage to read of approximately 250 words that 
has every fifth word deleted. The first and last sentence 
are left intact and the reader is to replace the deletion 
with the most logical or sensible word (Layton, 1979) - 

3. Frustrational Reading Level — the level of 
reading at which a student scores below 44% on a cloze 
procedure . 

4. Instructional Reading Level — the level of read- 
ing at which a student scores between 44% and 57% on a 
cloze procedure. 

5. Independent Reading Level — the level of reading 
at which a student scores above 57% on a cloze procedure. 

6 . SRA Achievement Series — a standardized achieve- 
ment test of reading and language abilities. The reading 
and language subtests will be used for this study. 

7. Nelson-Reading Test — a standardized reading of 
vocabulary and comprehension for use with grades 3-9. 
Only the reading comprehension section will be used for 
this study. 

9. SRA Short Test of Educational Ability — a test 
for determining a student's intelligence quotient and for 
measuring students ' general ability . 

16 
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Assumptions 

The statements below were assumed to be true for 
the purpose of completing the study. 

1 . It was assumed that the administration of the 
Nelson-Reading Test and S RA Achievement Series was a valid 
and reliable means of assessing student reading ability. 

2. It was assumed that students completed both 
standardized reading tests and the cloze procedures in an 
honest manner and to the best of their abilities. 

Collection of Data 

To complete this study, the following procedures 
were followed to collect the data. 

1. Cloze procedures, answer sheets, and answer 
keys were designed and written between the first and 
twelfth grade reading levels based on Spache (1966) and 
Dale-Chall (1948) readability formulae (Appendix A) . 
Content selection was guided by standards and recommenda- 
tions established by Bormuth (1968) . The cloze procedures 
were administered during the f al 1 semester to students at 
a university laboratory school in grades four and six over 
a two-day period . Each of the cloze procedures yielded 
percentage scores that were used to determine students 1 
independent, instructional, and f rust rational reading 
levels (Appendix B and C) . 

Id 
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2. The Nelson-Reading Test was administered during 
the f al 1 semester to students at a university laboratory 
school in grades four and six (Appendix C) . 

3. SRA Achievement Series Reading and Language 
subtest grade equivalent scores were obtained and collected 
from students' existing records (Appendix C) . 

4. SRA Short Test of Educational Ability ( SRA - MA) 
intelligence quotients were also obtained and collected 
from students' existing records (Appendix C) . 

Procedures 

Descriptions of the Group Participants 

In this study, students in two grades participated 
in the testing procedures. They were the fourth and sixth 
grades from a university laboratory school. There were 
approximately thirty students in each grade. Tests were 
administered and data collected during the day by two certi- 
fied teachers who were trained in test administration and 
scoring . 

Analysis of Data 

The data collected from each group were correlated 
and then multiple regression analysis was used to determine 
prediction equations using the NRT (Comprehension) , SRA 
(Reading) , and the three levels (independent, instructional, 
f rust rational ) of cloze procedure . 

- 17 
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Summary 

An answer to teachers 1 dilemma of determining and 
periodically monitoring students' reading levels, the 
readability of reading materials, and students 1 comprehen- 
sion levels may possibly be the cloze procedure. There- 
fore, the major purpose for this study was to provide more 
information as to the effectiveness and multiple use of a 
teacher -con st rue ted cloze procedure for classroom teachers 
to use . 

The remaining chapters contain a review of the 
literature related to the study, a description of the pro- 
cedure and instruments used in the study, the data and 
analyses of the data along with conclusions that were drawn 
from the findings, the summary, and recommendations. 
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Chapter 2 



REVIEW OF RELATED LITERATURE 

Introduction 

This report resulted from an investigation to 
determine whether or net teachers could develop appropri- 
ately leveled and shaped cloze procedures that would be 
significantly correlated to standardized reading tests . 
Que st ions to be answered appear below. 

1 . What di f f erences existed between 1 eve Is of 
reading comprehension as obtained through using standard- 
ized tests and those of the three levels (independent, 
instructional, and f rustrational ) of cloze proficiency? 

2 . What degree of relationship exi sted between the 
standardized reading test variables and those of the three 
levels of cloze procedure proficiency? 

3. Using selected standardized reading tests as 
the dependent variables, what independent or weighted 
combinations of independent variables were the best pre- 
dictors of the standardized reading tests when the data 
were subjected to multiple regression analysis? 

For the purpose of thi s study the literature 
related to cloze procedure will be presented in the follow- 
ing sections: (1) Historical View of Cloze Procedure, 
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(2) Variations of Cloze Procedure, (3) Empirical Support of 
Cloze Procedure as a test device , predictor of readability, 
and a technique to improve comprehension, and (4) Summary 
of Cloze Procedure . 

Historical View o f 
Cloze Procedure 

The cloze procedure originated before the twentieth 
century. It was originally known as the completion method 
test which was developed by Ebbinghaus (1897) . A half 
century later, Taylor (1953) introduced the cloze procedure 
as a device for assessing readability of reading materials. 
However, McKee (1948) recommended strongly the use of oral 
context to determine if children were ready to read and the 
use of contextual clues in reading to determine if 
students could read. Although McKee never expressed the 
term cloze procedure in his studies, his methods and stra- 
tegies were essentially cloze procedure. 

Taylor based the cloze procedure on two rationales. 
The first rationale was that of the Gestalt concept of 
closure. Taylor reasoned that the laws of closure could be 
applied if a person had to supply missing gaps in written 
materials (Pikulski & Tobin, 1982). The other rationale 
was based on the information theory (Kingston, 1977). 

For the next two decades cloze procedure was 
studied by numerous researchers in search of other uses of 
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the cloze procedure. Rankin (1959) studied cloze procedure 
and suggested that it may possibly be used to help students 
who were experiencing text difficulties in content area 
subjects. In another study, Bloomer (1967) purported cloze 
procedure to be useful in remedial reading situations with 
college students. Seemingly, the cloze procedure began to 
become more valuable than Taylor had contemplated. 

In a later study, Rankin (1965) concluded from his 
findings that cloze procedure was a valid measure of 
students' reading achievement. And later, Goodman (1967) 
suggested that cloze procedure could possibly be a device 
to effectively emphasize the use of semantic, syntactic, 
and graphophonic clue s which could possibly aid students ' 
abilities in unlocking the meaning of a writer's message. 

Support continued throughout the sixties for cloze 
procedure as Bormuth (1967, 1968) reported that cloze pro- 
cedure scores corresponded to traditional comprehension on 
reading tests. Furthermore, Bormuth 1 s study was repli- 
cated the following year by Rankin and Culhane (1969) , who 
reported very similar findings to those of Bormuth. 

In a different study , Ransom (1968 ) reported that 
students' scores on cloze procedures correlated well with 
an informal reading inventory used in grades two through 
six. During the 1960 1 s cloze procedure was studied exten- 
sively as a device for assessing the readability of reading 
materials, help with text difficulties in content subjects, 

2jl 
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a measure of reading achievement, an aid in helping stu- 
dents understand a writer's message, and to determine 
students' comprehension levels. 

Throughout the next decade cloze procedure was again 
studied extensively by researchers. Jongsma (1971) and 
Schell (1972) recommended the use of cloze as a successful 
teaching strategy for improving comprehension while Bortnick 
and Lopardo (1973) suggested that cloze procedure could 
possibly be employed as a comprehension building strategy. 
Apparently, earlier recommendations by Goodman became 
reality a s a result of research in the early 1970's. 
Rankin's earlier suggestions were also studied by Jones and 
Pikulski (1974) who reported cloze procedure scores to be 
more valid reading levels than standardized test scores. 
And, in 1974, Rankin followed his earlier findings with a new 
study and suggested that cloze procedure might possibly be 
an alternative to standardized tests of reading achievement. 

In another study, Bormuth (1975) studied the 
reliability of a cloze procedure of 250-300 words contain- 
ing 50 blanks and obtained a high correlation coefficient 
of .85 which accounted for 72% of the variance. Grove 
(1975), in another comprehension study, studied cloze pro- 
cedure in conjunction with basal readers and the language 
experience approach with first grade students. He con- 
cluded that cloze procedure was helpful in improving 
comprehension skills. 
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Despite its simplicity, cloze procedure continued 
to be studied by researchers. Carver (1976) reported from 
his findings that cloze procedure provided more valid 
functional reading levels than did standardized reading 
achievement. Comprehension skills were again reported to 
improve after use of cloze procedure in first grade studies 
by Blachowicz (1977) . 

Into the late 1970's, Weaver (1979) supported cloze 
procedure as a useful teaching tool at all grade levels 
while Goetz and Dixon (1979) studied how good and poor 
readers made use of metacognitive skills through the use of 
cloze procedure. Ryan and Willows (1979) conducted similar 
research on good and poor readers and they too used the 
cloze procedure to obtain their results. At the end of a 
second decade of cloze procedure research, cloze procedure 
had been used as a teaching technique, a testing device, a 
research device , comprehension improvement strategy , as an 
alternative to standardized reading tests, and as a valid 
predictor of functional reading levels. It appears as if 
the applicability of cloze procedure is endless. Yet, in 
the 1980 f s clo2e procedure has been studied and reported to 
be useful in another area related to reading. Baldauf 
and Propst (1981) suggested that a variation of cloze was 
very successful in evaluating the readability of reading 
materials for use with ESL students. 

2d 
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In summary, it appears that after over two decades 
of research, cloze procedure could easily be developed to 
assess virtually all reading behaviors and become an 
unlimited teaching technique for improving reading compre- 
hension and other related reading skills (Pikulski & Tobin, 
1982). Although not all studies concerning cloze procedure 
were included in the historical section of the related 
literature, it becomes apparent that cloze procedure has 
been studied extensive ly over the past two decades and a 
wealth of information and support for cloze procedure has 
been produced. 

Variations of Cloze Procedure 

Since its beginning , cloze procedure has been 
studied extensively for use in reading education. During 
the past few decades, different variations of cloze pro- 
cedure have been developed and deserve recognition since 
they were derived from Taylor's basic idea of cloze 
procedure . 

Gal lent (1965) introduced the maze technique as a 
variation of cloze procedure. The maze technique, unlike 
the traditional cloze procedure , had a multiple choice 
selection of three words at every fifth word's position. 
In the maze technique, Gallent proposed that the student 
was not supposedly hindered with recording answers and 
needed only to circle or underline the most sensible answer . 

24 



In support of Calient 1 s variation of elozo procedure, 
Guthrie, Siefart, Uurnham, and Kaplan (1974) reported that 
the maze technique could possibly bo useful in monilorinq 
students 1 reading progress and in selecting appropriate 1 
leveled reading materials for students to read. Likewise, 
Vacca (1981) commented that the maze technique appeared to 
possess great potential in estimating text difficulty* 

Another variation of the cloze procedure is the 
limited-cloze test developed for poor readers by Cunningham 
and Cunningham (1978). Unlike traditional cloze procedure, 
the deleted words are placed randomly in columns at the top 
of the page. Two major studies were conducted by the 
authors to validate the limited-cloze test. Internal cor- 
relation coefficients of .85 and .90 were obtained which 
may be interpreted to mean that the limited-cloze test was 
well shaped and leveled. In the same study, limited-cloze 
test scores also correlated highly with scores of the Iowa 
Test of Basic Skills . 

The post -oral reading cloze was deve loped by Page 
(1975) as a variation of cloze procedure in an attempt to 
link reading comprehension and oral reading evaluation . 
The post-oral reading cloze differs from the traditional 
cloze in that students are asked to read the cloze passage 
orally (no words omitted) and then complete the cloze pro- 
cedure silently. In his study, Page found that post-oral 
reading cloze scores and students 1 performance were highly 

26 
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correlated with traditional clozu procedure ucor^w. SiimiJctr 
rcfjults wore obtained in a replica to study by Ganier ( 1 y 7 1») 
and Carey (1978) in a similar utudy. Thoy reported pout- 
oral reading scores to be highly correlated with reading 
comprehension measures . 

Cunningham and Tiornoy (1977) developed the luast- 
major-constituent limited-cloze. In this variation of 
cloze procedure, every fifth lt*«ut-ma jor-com;ti tuent w.e; 
deleted. Like the limited-clc • t^st , the deleted words 
were randomly listed, but on jarate page. In their 

study, Cunningham and Tierney reporter high correlation 
coefficients when their procedure was compared to the tra- 
ditional cloze procedure. 

Another variation of cloze procedure was proposed 
by Schell (1972) in which only nouns or verbs were deleted. 
This variation was developed for use in the primary grades. 
Sche 11 reasoned that de leting parts of speech rather than 
every fifth word would help students to gain the meanings 
of different parts of speech. Later, Schell suggested that 
the teacher could progress to de leting ad j ectives and 
adverbs . 

In another variation of cloze, McWilliams and Rakes 
( 1979 ) deleted every seventh word instead of every fifth 
word . Their variation of cloze was to be used in content 
areas of social studies, science, and English. McWilliams 
and Rakes suggested that every seventh de let ion in content 
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materials with specialized vocabulary yielded more accurate 
grade placement scores. 

In summary, the variations of cloze procedure that 
received recognition in the review of related literature 
were the maze technique, the limited-cloze test, the post- 
oral reading cloze, the least-major-constituent limited- 
cloze, cloze procedure with parts of speech deletions, and 
cloze procedure for content materials with deletions of 
every seventh word. These variations of cloze procedure 
again support the idea that the multiple uses of cloze pro- 
cedure appear to be unlimited. 

Empirical Support of Cloze Procedure as a 
Test Device, Readability Measure, and 
Comprehension Improvement Technique 

Empirical support for cloze procedure as a test 
device began in the early 1960's, Bormuth, in 1963, 
reported that cloze procedure was educationally signifi- 
cantly correlated to multiple-choice comprehension tests, 
Ruddell, in 1964, found that cloze procedure was highly 
cor re lated to the paragraph meaning section of the 
Standford Achievement Test (Jongsma, 1971) , Rankin (1965) 
concluded from his study that cloze procedure appeared to 
be a valid measure of students 1 reading achievement. 

Bormuth (1967, 1968), in two other studies, 
reported that cloze procedure scores appeared to corre- 
spond highly with traditional comprehension scores on 
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reading tests. In a similar study, Rankin and Culhane 
(1969) obtained similar results as those of Bormuth. 

In a study comparing cloze procedure scores and 
informal reading inventory scores, Ransom (1968) reported 
high correlations between scores of the two assessment 
devices. Also, Jones and Pikulski (1974) suggested that 
cloze procedure scores were more valid than reading level 
scores of standardized tests. Following an earlier study, 
Rankin (1974) also concluded that cloze procedure may be a 
possible alternative to standardized tests of reading 
achievement . 

Empirical support of cloze procedure as a predictor 
of readability began in 1953. Taylor introduced the cloze 
procedure as a readability measure. In his study he found 
high correlations between the readability formulae and 
cloze rankings of the difficulty of each passage. Taylor 
interpreted his findings to mean that the cloze procedure 
produced more accurate results than did the readability 
formulae. In another study, Kingston and Weaver (1967) 
reported cloze procedure to be a much more accurate device 
for determining readability than readability formulae. 
Similar conclusions about cloze procedure as a readability 
measure were reported by Rankin and Culhane (1969) and 
Froese (1971). In a study with E5L students, Baldauf and 
Propst (1981) suggested that cloze procedure was very 
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successful in determining the readability of reading mater- 
ials for their students. 

Empirical support of cloze procedure as a technique 
for improving comprehension emerged with Goodman (1967). 
Goodman suggested that cloze procedure was an effective 
device for emphasizing the use of semantic, syntactic, and 
graphophonic clues and for determining the writer 1 s assage . 
The previous statement, in simplicity, is improvement of 
comprehensive skills . 

Cloze procedure in other related studies was recom- 
mended by Jongsma (1971) and Schell (1972) as successful 
teaching strategy for improving comprehension. In a 
similar; study, Bortnick and Lopardo (1973) suggested that 
cloze procedure could possibly be used as a comprehension 
building strategy. In his work with basal reading text- 
books and the language experience approach, Grove (1975) 
concluded that cloze procedure was useful in improving 
students 1 comprehension skills. Blachowicz (1977), in a 
first grade study, reported students 1 comprehension skills 
to improve after the use of cloze procedure, too. In 
summary, cloze procedure appears to be useful as a teaching 
tool for improving comprehension at all grade leve Is 
(Kingston, 1979) . 

In Chapter 2, a historical perspective of cloze 
procedure has been presented along with variations of cloze 
procedure, empirical support for cloze procedure as a test 

23 



22 

device, a predictor of readability, and as a technique for 
improving comprehension. Although the investigator did not 
cite all of the studies related to cloze procedure and its 
multiple uses, the information contained in Chapter 2 did 
support that cloze procedure has been extensively studied 
for over two decades, found to have multiple uses related 
to reading, and is supported by many researchers in its 
multiple uses. 
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Chapter 3 

DESIGN OF THE STUDY 

Introduction 

This report resulted from an investigation to 
determine whether or not teachers could develop appro- 
priately leveled and shaped cloze procedures that would be 
significantly correlated to standardized reading tests • 
Questions to be answered appear below. 

1 . What differences existed between levels of 
reading comprehension as obtained through using standard- 
ized tests and those of three levels (independent, 
instructional, and f rustrational) of cloze proficiency? 

2. What degree of relationship existed between 
the standardized reading comprehension test variables and 
those of the three levels of the c loze procedure 
proficiency? 

3 . Using selected standardised reading tests as 
the dependent variables, what independent or weighted 
combinations of independent variables were the best pre- 
dictors of the standardized reading tests when the data 
were subjected to multiple regression analysis? 
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Description of Subjects 

Students used in this study were mostly from 
middle-class homes. Many of the students 1 parents were 
university professors and staff members since a university 
laboratory school was used to obtain the subjects. The 
mean intelligence quotient for the total student population 
was 113 which may be interpreted to mean that a majority of 
the students in the study had average or above average 
intelligence. Students were selected who appeared to be 
reading grade level materials comfortably as observed by 
the classroom teacher and who had not previously repeated 
any grades . 

Although the selection of subjects procedure 
violates random sample requirements, it was a limitation of 
the study imposed by the investigator to determine if the 
cloze procedure was an adequate predictor of reading 
achievement by students who were not experiencing diffi- 
culties in reading. Further studies , however , should 
include the use of randomly selected groups of students. 

Descriptions of the Tests / 
Instruments / and Data 
Collecting Procedures 

The Nelson-Reading Test form A was administered to 
sixty subjects duriny the first month of school in a group 
situation. The test was administered according to 
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instructions in the examiner's manual. The Nelson-Reading 
Test was selected for use in this study for several reasons. 
The Nelson-Reading Test has been widely used nationally as 
a standardized reading test for grades three through nine. 
The complete test requires approximately thirty minutes 
to administer. The test has two parts: (1) a vocabulary 
section, and (2) a comprehension subtest. 

The Nelson-Reading Test (form A) was reported to 
have a total reliability coefficient of .93 for both 
sections of the test. When compared to the Iowa Tests of 
Basic Skills , a validity range of .70 to .88 and .62 to .76 
were reported for vocabulary and paragraph comprehension, 
respectively. The Nelson-Reading Test has been studied 
extensively by researchers and has been reported to be an 
effective and reliable measure of reading achievement 
(Buros, 1968) . 

The SRA Achievement Series was administered to 
obtain subtest scores of reading and language ability. The 
SRA Achievement Series is also a widely used achievement 
test. Product-moment correlations between .75 ana .81 have 
been reported for grade levels second through ninth. This 
standardized test has also been studied extensively by 
researchers and has been reported useful in measuring 
general reading ability of children above second grade 
placement (Buros, 1968) . 
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Cloze tests were constructed along with answer 
sheets and keys. The teacher-constructed cloze tests were 
also administered during the first month of school. The 
cloze tests were shaped and developed using the Spache 
(1974) and Dale-Chall (1948) readability formulae. 
Standards established by Bormuth (1968) were used to guide 
the syntactical and semantical design of the selections and 
to determine independent, instructional, and f rustrational 
levels (Appendix B) . 

Intelligence quotients were obtained from students' 
records using the SRA Short Test of Mental Abilities 
(SRA [MA] ) . The SRA (MA) consists of a verbal and non- 
verbal section with a standard score scale of 100 which 
increases by 0.5 each grade year through grade ten . The 
SRA (MA) has been a widely used measurement tool for those 
factors thought to be closely related to academic per- 
formance. High correlations (.72+) have also been reported 
for the SRA (MA) when compared to the SRA Primary Mental 
Abilities Test and the SRA Tests of Educational Ability . 

After the data from all the instruments were 
collected , scored , and recorded , statistical analyses were 
calculated to find the correlations between the NRT 
(Comprehension), SRA (Reading), SRA (Language), and SRA (MA) 
and the selected levels of teacher-constructed cloze 
procedure . 
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Multiple regression statistical analysis models 
were developed to analyze in determining the best weighted 
or single combinations of the independent variables and 
their degrees of strength to predict the dependent 



is . 


Those variable? were as 


follows : 




Variable 


Type 


1. 


NRT (Comprehension ) 


dependent 


2. 


SRA (Reading) 


dependent 


3. 


SRA (Language) 


dependent 


4. 


SRA (MA) 


independent 


5, 


Cloze (independent) 


independent 


6. 


Cloze (instructional) 


independent 


7. 


Cloze (f rustrational ) 


independent 



The results of the statistical analyses are pre- 
sented in Chapter 4. 

Summary 

Characteristics of the subjects used in this study 
were described, procedures for selection and administration 
of tests, and validity and reliability data for the tests 
were described in Chapter 3. Finally, the statistical 
methods selected to analyze the data were presented. 

Chapter 4 contains the data collected for the study 
by the procedures outlined in Chapter 3. Chapter 5 con- 
tains conclusions , summaries , and implications . 
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Chapter 4 

FINDINGS AND ANALYSES 

Introduction 

This report resulted from an investigation to 
determine whether or not teachers could develop appro- 
priately leveled and shaped cloze procedures that would be 
significantly correlated to standardized reading tests. 
The questions to be answered as a result of the treatment 
of the data appear below. 

1. What differences existed between levels of 
reading comprehension as obtained through using standard- 
ized tests and those of three levels (independent, instruc- 
tional, and f rustrational) of cloze proficiency? 

2. What degree of relationship existed between the 
standardized reading comprehension test variables and those 
of the three levels of the cloze procedure proficiency? 

3. Using selected standardized reading tests as 
the dependent variables, what independent or weighted 
combinations of independent variables were the best pre- 
dictors of the standardized reading tests when the data 
were subjected to multiple regression analysis? 
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Descriptive Statistical 
Analysis 



To obtain the answers to those questions, multiple 
regression analysis was employed. To provide a better base 
for interpreting the data collected, means, standard 
deviations , and Pearson product-moment correlations were 
also computed and analyzed. The mean and standard devia- 
tion of the fourth grade are shown below. 

Table 1 

Means and Standard Deviations for 
Reading , Intelligence , and 
Language of 4th Grade 
Students 

N = 30 







Standard 


Variable 


Mean 


Deviation 


C.l NRT (Comprehension) 


5.8 


1.75 


C.2 SRA (Reading) 


5.4 


1.81 


C.3 SRA (MA) 


116 


13.6 


C.4 SRA (Language 


5.8 


1.15 


C.5 Cloze (Independent) 


2.8 


1. 85 


C.6 Cloze (Instructional) 


4.3 


1.71 


C.7 Cloze (Frustrational) 


5.2 


1.74 



The fourth grade students 1 mean intelligence score 
was 116. This high score suggests that the majority of 
students tested appeared to possess adequate, if not above 
average, verbal and non-verbal intellectual abilities 
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supporting the information in Chapter 3 that the students 
were chosen who exhibited comfortable control of grade 
level reading materials. Students 1 mean scores for the 
NRT (Comprehension) , SRA (Reading) , and SRA (Language) 
ranged from 1.4 years to 1.8 years above grade level while 
students 1 mean cloze procedure scores ranged from 2.2 years 
below grade level to 1.2 years above grade level. Students 
mean scores at the instructional level on the cloze pro- 
cedure yielded the closest grade placement of .3. years 
above grade level which could be interpreted to mean that 
the cloze procedure score could possibly provide a more 
realistic grade equivalent score if there is a need to have 
scores that are commensurate with students 1 grade placement, 
Hcwever, that was not one of the purposes of this investi- 
gator and no statistical data is available to support the 
idea . 

The sixth grade students 1 mean intelligence score 
was 113. This high score suggests that the majority of 
students tested also appeared to possess adequate, if not 
better than average, verbal and non-verbal abilities. To 
support the information in Chapter 3 that students were 
chosen who exhibited comfortable control of grade level 
reading materials, it can be seen that the students 1 mean 
scores on the NRT (Comprehension), SRA (Reading) , and the 
SRA (Language) ranged from 1.3 years to 2.4 years above 
grade level while the students 1 mean cloze procedure scores 
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Table 2 

Means and Standard Deviations i : or 
Reading , Intelligence , and 
Language of 6th Grade 
Students 

N = 30 



Variable 


Mean 


Standard 
Deviation 


C. 1 NRT (Comprehension) 


8.4 


2.77 


c - 2 SRA (Reading) 


7.9 


1.90 


C.3 SRA (MA) 


113 


9.92 


C.4 SRA (Language) 


7.3 


1.59 


C . 5 Cloze ( Independent 


3.4 


1.74 


C.6 Cloze (Instructional) 


5.4 


1.77 


C.7 Cloze (Frustrational ) 


6 . 4 


1.77 



ranged from 2.G years below grade level to .4 years above 
grade level. Students 1 mean scores on the cloze procedure 
at the instructional and frustrational levels were .6 years 
below grade level and .4 years above grade level. That may 
be interpreted to mean that the cloze procedure instruc- 
tional and frustrational level score would possibly provide 
a more realistic grade equivalent score if there is a need 
to have scores that are commensurate with students 1 grade 
placement. Again, that was not one of the purpos.es of this 
investigator and no statistical data are available to 
support this idea. 
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Table 3 

iv ans and Standard Deviations for 
Readincj , Intelligence , and 
Lanqua^e of 4th and 6th 
Grade Students 

N = 60 



Variable 


Mean 


Standard 
Deviation 


C.l NRT (Comprehension) 


7.1 


2.64 


C.2 SRA (Reading) 


6.7 


2 .23 


C.3 SRA (MA) 


114 


11 . 9 


C.4 SRA (Language) 


6.6 


1.56 


C.5 Cloze (Independent) 


3.1 


1.80 


C.6 Cloze (Instructional) 


4.9 


1.82 


C.7 Cloze (Frustrational ) 


5.8 


1.84 



The combined mean score of grades four and six was 
114* Again, this high score suggests that the majority of 
students tested appear to have adequate , i f not above 
average, verbal and nonverbal abilities- To support the 
information in Chapter 3 that students were chosen who 
exhibited comfortable control of grade level reading mater- 
ials, it may be noticed that the students' mean scores on 
the NRT (Comprehension) , SRA (Reading) , and SRA (Language) 
ranged from 6.6 years to 7.1 years while students 1 cloze 
procedure scores ranged from 3.1 years to 5.8 years. 

When observing the di f fere nee s in the scores of 
fourth and sixth graders, a two-year growth would normally 
be expected to exist. However/ differences between scores 
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Table 4 

Di f f erences Between Mean Scores of 4th 
and 6th Grade Students on the NRT, 
SRA Reading Subtest, SRA Language 
Subtest, and the Cloze Test 



Variable 


6 4 


C . 1 NRT ( Comprehension 


2.6 


C.2 SRA (Reading 


2.5 


C.3 SRA (MA) 




C.4 SRA (Language) 


1.5 


C.5 Cloze (Independent) 


.6 


C.6 Cloze (Instructional) 


1.1 


C.7 Cloze (Frustrational) 


1.2 



of fourth and sixth graders on the NRT (Comprehension) , 

SRA (Reading) , and SRA (Language) ranged from 1.5 years to 

v 

2 . 6 while students 1 cloze procedure score differences 
ranged from . 6 years to 1.2 years . Therefore , no signifi- 
cant interpretation can be drawn from the data. 

Tables 1 , 2 , and 3 can be interpreted to reveal 
that students 1 cloze scores proceed progressively higher 
from the independent level to the frustrational level 
(Appendix D) . Closer examination of the data reveals 
consistent di ff erences of .9 years , 1.0 years , .9 years 
respectively between the instructional level and frustra- 
tional level and consistent differences of 1.5 years, 2.0 
years , 1.8 years respectively between the independent 
levels and instructional levels that appear to be reasonable 
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differences among cloze procedure levels. This may be 
interpreted to mean that the selections on cloze pro- 
cedures were shaped well (Appendix A) . 

Many authorities purport that standardized tests 
yield frustration levels. Students 1 cloze scores at the 
f rustrational level were close to grade placement which 
suggests that cloze procedures may be valid and reliable 
testing instruments . 

Standard deviations were consistent in both grades 
for each achievement score except for the SRA (Language) 
which resulted in a tighter range of scores for both groups. 

Correlations 

Tables 5, 6, and 7 contain a summary of the results 
from correlations between the NRT (Comprehension) , SRA 
(Reading) , SRA (MA) , SRA (Language) , and cloze procedure 
scores for grades 4 and 6. 

All correlation coefficients except two meet or 
exceed the .35 critical value (.05 level) for statistical 
significance. However, C.3 - C.5 and C.3 - C.7 do not 
approach significance. The correlation coefficients 
between variables showing highest levels of positive cor- 
relations are as follows: 

Cloze (Instructional) ■ Cloze (Frust rational ) r = .99 
Cloze (Independent) • Cloze (Instructional) r= .92 
Cloze (Independent) • Cloze (Frustrational ) r= .91 
NRT (Comprehension) • SRA (Language) r = .82 
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Table 5 

Pearson Product Moment Correlations Among 
Standardized Reading, Language, and 
Intelligence Scores and Cloze Test 
Scores: Grade 4 

N = 30 



Product Moment Values 



Variables 


C.l C.2 C.3 


C.4 


C. 5 


C.6 


C.l 


C.l NRT (Comprehension) 


- .39 .49 


. 82 


. 52 


. 56 


.54 


C.2 SRA (Reading) 


- . 36 


.50 


. 57 


. 65 


.61 


C.3 SRA (MA) 




.45 


.30 


. 36 


.34 


C.4 SRA (Language) 






.46 


. 55 


.52 


C5 Cloze (Independent) 








.92 


.91 


C.6 Cloze (Instructional) 










.99 


C.l Cloze (Frustrational ) 













D.F. = 28 
p. 05 = .35 



The extremely high correlation coefficients among 
cloze procedure levels indicate that students 1 achievement 
levels on this cloze procedure are almost perfectly cor- 
related and may be interpreted to mean that levels measured 
by cloze are highly reliable for determining students' 
independent , instructional , and frustrational reading 
levels. In view of the mean scores reported earlier 
(Table 1) , it appears that the cloze procedure will also 
differentiate between levels and be approximately closer to 
actual grade placenent using the cloze procedure instruc- 
tional level . 
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The next highest correlation coefficient ( . 82 ) 
indicates that there is a strong educationally significant 
correlation between reading score of the NRT (Comprehension) 
and SRA (Language). However, this strong relationship is 
not surprising since many authorities believe that reading 
and language are closely interwoven. Interestingly, the 
correlation coefficient for NRT (Comprehension) and SRA 
(Language) (r = .82) was much higher than coefficients for 
SRA (Language) ' SRA (Reading) and SRA (Language ) • SRA (MA) . 
Apparently, the SRA (Language) and NRT (Comprehension are 
measuring much of the same skills, but SRA achievement sub- 
tests appears to be more distinct in skills measured, which 
should be found if the subtests truly measure different 
skills . 

As stated earlier, all but two correlation coeffi- 
cients met or exceeded the critical value of .35 at the .05 
level. However, 42% of the correlation coefficients 
appeared to be approaching educational significance (.71). 
They are as follows: 



SRA 


(Reading) 


• Cloze 


(Instructional ) 


r 




.65 


SRA 


(Reading ) 


• Cloze 


(Frust rational) 


r 




.61 


SRA 


(Reading) 


• Cloze 


(Independent) 


r 




. 57 


NRT 


(Comprehension) 


• Cloze 


(Instructional ) 


r 




.56 


SRA 


(Language) 


• Cloze 


(Instructional) 


r 




. 55 


NRT 


(Comprehension) 


• Cloze 


(Frustrational ) 


r 




.54 


SRA 


(Language ) 


• Cloze 


(Frust rational) 


r 




.52 


NRT 


(Comprehension) 


' Cloze 


(Independent) 


r 




.52 


SRA 


(Reading) 


• SRA (Language) 


r 




.50 
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Within the correlations listed above, only 25% to 
42% of the variance is accounted for; still, based on some 
other correlational studies, the coefficients above could 
be interpreted to mean that the cloze levels are sta- 
tistically significantly correlated to standardized test 
scores of reading and language achievement. 

Table 6 

Pearson Product Moment Correlations Among 
Standardized Reading , Language , and 
Intelligence Scores and Cloze Test 
Scores : Grade 6 

Product Moment Values 



Variables 


C.l C.2 C.3 C.4 


C.5 


C.6 


C.7 


C.l NRT (Comprehension) 


- .48 .22 .76 


.52 


.59 


.58 


C.2 SRA (Reading) 


- .41 .57 


.43 


.49 


.47 


C.3 SRA (MA) 


- .22 


. 52 


.45 


.47 


C.4 SRA (Language 




.50 


.71 


.71 


C.5 Cloze (Independent 






.87 


. 87 


C.6 Cloze (Instructional) 








.98 


C.7 Cloze (Frustrational) 











D.F. = 27 
p. 05 = .36 



All correlation coefficients except two meet or 
exceed the .35 critical value (.05 level) for statistical 
signi f icance . The correlation coefficients between 
variables showing highest levels of positive correlations 
are as follows: 
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Cloze ( Instructional) 


• Cloze 


(Frustrational ) 


r = 


.98 


Cloze ( Independent) 


• Cloze 


( Instructional ) 


r = 


.87 


Cloze (Independent) 


' Cloze 


(Frustrational ) 


r = 


.87 


NRT (Comprehension) 


• SRA (Language ) 


r = 


.76 


SRA (Language ) 


' Cloze 


(Instructional) 


r = 


.71 


SRA (Language) 


' Cloze 


(Frustrational) 


r = 


.71 



The extremely hi gh correlation coef f icients among 
cloze procedure levels indicate that students 1 achievement' 
levels on this cloze procedure are highly correlated and 
may be interpreted to mean that levels measured by cloze 
are highly reliable, as found earlier (Table 2) , for deter- 
mining students 1 independent, instructional, and frustra- 
tional reading levels. Again, it appears that the cloze 
procedure may also differentiate between levels and be 
approximately closer to actual grade placement using the 
cloze procedure instructional level. 

The next highest correlation coefficient indicates 
that there is a strong educationally significant correla- 
tion between the NRT (Comprehension) and SRA (Language) . 
As before, this value is not surprising and indicates that 
the NRT (Comprehension) and SRA (Language) probably are 
measuring many of the same skills. In support of earlier 
data presented in Chapter 3, the SRA subtests appear to be 
measuring distinct skills, as they should. 

The correlation coefficients for SRA (Language) • 
Cloze (Instructional) and SRA (Language) • Cloze (Frustra- 
tional) were .71 which is considered to be not only 
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statistically, but educationally significant. These 
results indicate that 50% or more of the variance between 
cloze procedure instructional and f rustrational levels is 
accounted for when they are correlated highly with SRA 
(Language) scores which may be interpreted to mean that 
cloze procedure levels are significantly correlated to the 
SRA (Language ) subtest . 

Other correlation coefficients did appear to be 
approaching educational significance (.71). They are as 
follows : 

NRT (Comprehension) • Cloze (Instructional) r = . 59 
NRT (Comprehension) • Cloze (Frustrational ) r = .58 
SRA (Reading) • SRA (Language) r - . 57 

NRT (Comprehension) • Cloze (Independent) r = .52 
SRA (MA) • Cloze (Independent) r = . 52 

SRA (Language) • Cloze (Independent) r = . 50 

Within the correlations listed above, only 25% to 
35% of the variance can be accounted for; however, the 
coefficients listed could still be interpreted to mean that 
the cloze levels are statistically significantly correlated 
to the standardized test scores of reading and language 
achievement . 

Table 7 contains the combined results of correla- 
tion coefficients for the 4th and 6th grade. All correla- 
tion coefficients except three meet or exceed the .35 
critical value (.05 level) for statistical significance. 
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Table 7 

Pearson Product Moment Correlations Among 
Standardized Reading , Language , and 
Intelligence Scores and Cloze Test 
Scores: Grades 4 and 6 

N = 60 



Product Moment Values 



Variables 


C.l C.2 C.3 C.4 


C.5 


C.6 


C.7 


C.l NRT (Comprehension) 


- .59 .22 .83 


.51 


. 62 


.62 


C.2 SRA (Reading) 


- .25 .65 


.50 


. 62 


.60 


C.3 SRA (MA) 


- . 23 


.37 


. 33 


.33 


C.4 SRA (Language 




.49 


. 68 


.67 


C.5 Cloze (Independent) 






. 88 


.88 


C.6 Cloze (Instructional) 








. 98 


C.7 Cloze (Frustrational ) 











D.F. = 55 
p. 05 = .26 

The correlation coefficients between variables showing 

highest levels of positive correlations are as follows 

Cloze (Instructional) • Cloze (Frustrational) r = .98 

Cloze (Independent) * Cloze (Instructional) r = .88 

Cloze (Independent) * Cloze (Frustrational) r = .88 

NRT (Comprehension) * SRA (Language) r = .83 



The extremely high correlation coefficients among 
cloze procedure levels indicate that students 1 achievement 
levels on this cloze procedure are almost perfectly cor- 
related and may be interpreted to mean that levels measured 
by cloze for 4th and 6th graders are highly valid (77%-96%) 



43 



for determining students 1 independent, instructional, and 
f rustrational reading levels by cloze procedure. In view 
of mean scores reported earlier (Table 3) , it appears that 
the cloze procedure will also differentiate between levels 
and be approximately closer to actual grade placement using 
the cloze procedure instructional level • 

The next highest correlation coefficient indicates 
that there is a strong educationally significant correla- 
tion (r = .83) between NRT (Comprehension) and SRA 
(Language). Interestingly, this result could be interpreted 
to mean that the NRT (Comprehension) and SRA (Language) 
appear to be measuring the same skills. This correlation 
coefficient (.83) was higher than coefficients for SRA 
(Reading) • SRA (Language) , S RA (Language) • SRA (MA) , and 
SRA (Reading) • SRA (MA) whose scores were r = .65, r = ,23, 
and r = .25 respectively. If SRA subtests do indeed 
measure distinct skills, then the results above may be 
interpreted to mean that the SRA (MA) is not correlated 
well with the other SRA subtests. However, SRA (Language) 
and SRA (Reading) correlation coefficient (r = .65) may be 
interpreted to mean that the two subtests are approaching 
an educationally significant level indicating that they may 
possibly be measuring similar skills. 

As stated earlier, all but three correlation 
coefficients meet or exceed the critical value of .35 at 
the .05 level. Four correlation coefficients were also 



found to be highly significant and 47% of the correlation 
coefficients appeared to be approaching educational sig- 
nificance (r = .71). They were as follows: 



SRA 


(Language) 


• Cloze 


(Instructional ) 


r 


— 


.68 


SRA 


(Language ) 


• Cloze 


( Fr us t rational ) 


r 




.67 


SRA 


(Reading) 


SRA (Language ) 


r 




.65 


NRT 


(Comprehension) 


• Cloze 


(Instructional) 


r 




.62 


NRT 


(Comprehension) 


• Cloze 


(Frustrational ) 


r 




. 62 


SRA 


(Reading) 


• Cloze 


(Instructional ) 


r 




.62 


SRA 


(Reading) 


* Cloze 


(Frustrational ) 


r 




.60 


NRT 


(Comprehension) 


# SRA (Reading) 


r 




.59 


NRT 


(Comprehension) 


* Cloze 


(Independent) 


r 




.51 


SRA 


(Reading) 


• Cloze 


(Independent) 


r 




.50 


SRA 


(Language) 


• Cloze 


( Independent) 


r 




.49 



Within the correlations listed above only 24% to 
46% of the variance is accounted for; still, based on some 
other correlational studies, the coefficients above could 
be interpreted to mean that the cloze levels are statisti- 
cally significantly correlated to standardized test scores 
of reading and language achievement. However, their educa- 
tional significance may be questionable. 

Multiple Regression Analysis 

Multiple regression analysis was used to determine 
the value of six variables in combinations and independently 
as predictors of Nelson-Reading Test score in grade four, 
six, and combined (Tables 8, 9, and 10). 
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Table 8 



Multiple Regression Model for Predicting 
Nelson-Reading Test Score for Grade 4 

N = 30 



Model 










R 


R2 


1 • 2 


3 


4 


5 


6 7 


.85 


.73 


1 ' 2 


3 


A 


5 


6 


. 85 


.73 


1 • 2 


3 


4 


5 




. 85 


.73 


1 • 2 


3 


4 






.83 


.69 


1 • 2 


3 








. 54 


.30 


1 ' 6 


7 








. 57 


.33 


1 • 5 


6 


7 






. 57 


.33 


1 • 4 


5 


6 


7 




.83 


.70 


1 • 3 


4 


5 


6 


7 


.84 


.72 



Table 9 

Multiple Regression Model for Predicting 
Nelson-Reading Test Score for Grade 6 

N = 30 



Model 










R 


R2 


1 • 2 


3 


4 


5 


6 7 


. 79 


.63 


1 ' 2 


3 


4 


5 


6 


. 78 


.62 


1 • 2 


3 


4 


5 




. 78 


.61 


1 • 2 


3 


4 






.76 


.59 


1 • 2 


3 








.47 


.23 


1 ' 6 


7 








. 59 


. 35 


1 ' 5 


6 


7 






.59 


. 35 


1 • 4 


5 


6 


7 




.79 


.63 


1 • 3 


4 


5 


6 


7 


.79 


.63 
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Table 10 

Multiple Regression Model for Predicting 
Nelson-Reading Test Score for 
Grades 4 and 6 

N = 60 



Model R R 



1 • 


' 2 


3 


4 


5 


6 7 


. 84 


. 71 


1 • 


■ 2 


3 


4 


5 


6 


. 84 


.71 


1 • 


' 2 


3 


4 


5 




. 83 


.70 


1 • 


■ 2 


3 


4 






. 83 


. 69 


1 ' 


' 2 


3 








.60 


. 36 


1 • 


6 


7 








. 62 


. 39 


1 ' 


1 5 


6 


7 






.63 


. 40 


1 • 


4 


5 


6 


7 




. 83 


. 70 


1 ' 


■ 3 


4 


5 


6 


7 


.83 


. 70 



Extremely high statistical significant R 's were 

obtained for the first four and last two multiple regression 

models in both the fourth and sixth grade and the combina- 

2 

tion of both grades. The high R 's for the first four 

models may be interpreted to mean that there is little or 

no difference in the predictive strength when each of the 

2 

cloze levels were deleted from the model. The high R f s 
for the last two multiple regression models may be inter- 
preted to mean that there was little or no difference in 
predictive strength where the SRA (Reading) and SRA (MA) 
were omitted. Close observation does reveal that the SRA 
(Language) appeared to be the most influential predictor 



of the NRT (Comprehension) scores. The least influential 

variables were the cloze procedure variables. 

Tables 11, 12, and 13 contain multiple regression 

mode. Is used to predict the SRA (Reading) scores of the 

fourth and sixth grades and in combination of both. 

2 

Highest R values were obtained for the first throe 
models of all three charts. However, only 16%-26^ of the 
variance can be accounted for with these models and as 
earlier, there appears to be little or no difference in the 
predictive strength of the model when cloze levels are 
deleted. Tables 11, 12, and 13 may also be interpreted to 
mean that no single or combinations of independent variables 
were good predictors of SRA (Reading) scores. 

Table 11 

Multiple Regression Model for Predicting 
SRA Reading Score for Grade 4 

N = 30 



Model R R 



2 ' 


• 1 


3 


4 


5 


6 7 


. 72 


.52 


2 ' 


' 1 


3 


4 


5 


6 


.69 


.48 


2 ' 


' 1 


3 


4 


5 




.66 


.44 


2 ' 


' 1 


3 


4 






. 52 


. 28 


2 ' 


' 1 


3 








. 43 


. 19 


2 ' 


' 6 


7 








.69 


.48 



53 



4G 

Table 12 

Multiple Regression Model for Predicting 
SRA Reading Score for Grade 6 

N « 30 



Model r r 



2 ' 


• 1 


3 


4 


5 


6 7 


.66 


.44 


2 


• 1 


3 


4 


5 


6 


. 64 


.41 


2 ' 


■ 1 


3 


4 


5 




.64 


.41 


2 • 


■ 1 


3 








.57 


.33 


2 ' 


' 6 


n 








.48 


.24 



Table 13 

Multiple Regression Model for Predicting 
SRA Reading Score for Grades 4 and 6 

N = 60 



Model r r 

2-134567 .70 .49 

2-13456 .70 .49 

2-1345 .68 .47 

2-134 .66 .44 

2 ' 1 3 .60 .36 

2-67 .61 .38 
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Analysis of Data in Regard to 
Hypothesis and Questions Asked 

The nail hypotheses written for this study are as 

follows . 

1. There will not be significant positive correla- 
tions among reading levels obtained from the NRT (Compre- 
hension), SRA (Reading), and the three reading levels 
(independent, instructional, and f rustrational) of cloze 
procedure proficiency. 

2. There will not be positive, significant correla 
tions between selected weighted combinations of independent 
variables and standardized reading tests when data are 
subjected to multiple correlational analysis. 

Based on correlation coefficients obtained from the 
data for this study, the null hypotheses are rejected. 
There were significant positive correlations between read- 
ing levels obtained from standardized tests and the three 
reading levels of cloze procedure. There were also posi- 
tive, significant correlations between selected weighted 
combinations of independent variables and standardized 
reading tests. However, in the case of the predictive 
value of the cloze tests, they have little predictive 
strength in the full models. 

The questions asked are presented below, followed 
by answers to each one. 
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1. What differences existed between levels of 
reading comprehension as obtained through using standard- 
ized test 1 ", and those of three levels (independent, instruc- 
tional, and f rustrational) of cloze procedure proficiency? 

Standardized te st scores consistently placed stu- 
dents above their grade level while selected cloze procedure 
level scores consistently placed students closer to their 
grade level. The cloze procedure instructional level was 
consistently closest to the students' actual grade placement . 

2 . What degree of relationship existed between the 
standardized reading comprehension test variables and those 
of the three levels of cloze procedure proficiency? 

The cloze procedure instructional and f rustrational 
levels correlated highly with the standardized test 
variables. Although no educationally significant scores 
were obtained, a range of correlation coefficients of .60 
to .68 were obtained which may be interpreted to mean that 
the correlation between selected cloze procedure levels and 
standardized tests variable was approaching educational 
significance (.71). Therefore, the correlational coeffi- 
cients obtained can be considered educationally useful. 

3. Using selected standardized reading tests as 
the dependent variables, what independent or weighted 
combination of independent variables were the best pre- 
dictors of standardized reading test scores when the data 
were subjected to multiple regression analysis? 
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The following models were found to be best pre- 
dictors of the NRT (Comprehension) . 

1-234567 R 2 = .71 

1-23456 R 2 =.71 

1-2345 R 2 = .70 

1-4567 R 2 = .70 

1*34567 R 2 = .70 

The results above may be interpreted to mean that 
no single variable was found to be a significant predictor 
of the NRT (Comprehension) and that several assessment 
devices are needed in order to determine students 1 approxi- 
mate reading achievement. None of the combinations in the 
models appeared to have high predictive value for the SRA 
(Reading) variable . 

Summary 

Chapter 4 contained the data collected by the pro- 
cedures in Chapter 3. A descriptive statistical analysis 
was presented and the results of the analyses of data were 
discussed. The null hypotheses were rejected. Questions 
were an swered . 

An interpretive discussion of the statistical 
analyses, conclusions , implications , and recommendations 
for future research are contained in Chapter 5. 
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Chapter 5 



SUMMARY , CONCLUSIONS, AND 
RECOMMENDATIONS 



Introduction 



This report resulted from an investigation to 
determine whether or not teachers could develop appro- 
priately leveled and shaped cloze procedures that would be 
significantly correlated to standardized tests. Questions 
to be answered appear below, 

1. What differences existed between levels of 
reading comprehension as obtained through using standard- 
ized tests and those of three levels (independent, instruc- 
tional, and f rustrational) of cloze proficiency? 

2. What degree of relationship existed between the 
standardized reading comprehension test variables and those 
of the three levels of cloze procedure proficiency? 

3. Using selected standardized reading tests as 
dependent variables, what independent or weighted combina- 
tions of independent variables were best predictors of 
standardized reading tests when the data were subjected to 
multiple regression analysis? 
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Summary 

This report contains a review of the literature 
related to cloze procedure. A historical view as well as 
variations cf cloze procedure and empirical support of 
cloze procedure as a test device, a measure of readability, 
and a technique for improving comprehension have been dis- 
cussed. Cloze procedure has been found to be applicable in 
many areas of reading and to be valid in those areas, too. 

Students in fourth and sixth grade participated in 
this study during the first month of school. Testing was 
administered by qualified teachers during the course of an 
average day. 

The null hypotheses were rejected and questions 
were answered. Those answers are given below. 

There were differences in standardized test scores 
and selected levels of cloze procedure proficiency. 
Standardized test scores consistently placed students above 
actual grade placement while scores of the three levels of 
cloze procedure proficiency placed students closer to their 
actual grade placement. Cloze procedure instructional 
level scores were found to be closest for actual grade 
placement. 

There were highly statistically significant corre- 
lations between cloze procedure instructional and 
frustrational levels and the standardized test variables. 
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Correlation coefficients of .60 to .68 were obtained which 
may be interpreted to mean that the instructional and 
f rust rational leve Is were approaching educational signifi- 
cance and therefore can be considered to be highly 
correlated and educationally useful in determining students 1 
reading levels. 

Multiple regression analysis was computed and there 
appeared to be several prediction models that could be 
considered educationally useful in predicting the NRT 
(Comprehension). They were as follows: 234567, R 2 = 
.71; 2 3 4 5 6, R 2 = .71; 2 3 4 5 , R 2 = .70; 4 5 6 7 , R 2 = 
.70; and 34567, R =.70. These results may also be 
interpreted to mean that no one variable was significantly 
better at predicting reading achievement. Subsequently, to 
determine approximate and valid reading levels of students, 
a series of tests should be used and not any one test by 
itself. However, it should be noted that the language 
variable of the SRA test did account for a large amount of 
variance singly. 

Conclusions 

In view of Spache's idea that many teachers are 
unable to develop appropriately leveled and shaped reading 
assessment materials, the results of this study may be used 
to cast doubt on his claim. Almost perfect correlation 
coefficients were obtained for the three levels of cloze 



60 



procedure proficiency. Therefore, the data may be inter- 
preted to mean that the teacher-constructed cloze procedures 
were appropriately leveled and shaped. Although correlation 
coefficients did not meet the educational significant leve 1 
(.71) , several correlation coefficients exceeded the . 6 0 
level which may be interpreted to mean that the cloze pro- 
cedure levels were correlated highly with reading achieve- 
ment test variables and therefore could be considered to be 
educationally useful in assessment of students' reading 
achievement . 

Recommendations 

Normally, in the recommendations of Chapter 5, 
investigators list implications for further research. How- 
ever, this investigator feels, in light of the research 
given and the enormous amount of research read that was not 
included in the study, that the available research in the 
area of cloze procedure appears to be quite impressive and 
that a better recommendation would be to begin to encourage 
and teach teachers of the multiple uses of cloze procedure 
and how to develop cloze procedure for use in the classroom. 

One of the major purposes of this study was to pro- 
vide information concerning the fact that teachers do 
appear to have a dilemma of assessing and periodically 
monitoring various aspects of students 1 reading abilities 
and that cloze procedure can provide teachers with quick, 
easy, and valid results abc students 1 reading abilities. 
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APPENDIX B 

MASTER LIST SCORES FOR CLOZE PROCEDURE 
PROFICIENCY LEVELS FOR 
GRADES FOUR AND SIX 
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67 



Of. 



Subjects 


Selections 
1 2 


3 


4 


5 


6 


7 


4th Grade 
















1 


642 


482 


422 


622 


422 


22 




2 


642 


422 


602 


622 


482 


222 




3 


642 


522 


602 


682 


262 






4 


8C2 


722 


762 


682 


642 


422 


62 


5 


682 


542 


642 


682 


262 






6 


622 


402 


442 


242 








7 


542 


28% 


382 


322 


382 


242 


182 


8 


582 


382 


522 


322 








9 


462 


302 


162 


82 








10 


542 


382 


322 


282 


362 . 


222 


142 


11 


542 


502 


102 










12 


682 


302 


62 


422 


242 






13 


702 


602 


502 


582 


422 


362 


202 


14 


762 


482 


462 


222 








15 


762 


502 


562 


242 








16 


642 


482 


522 


122 








17 


682 


482 


502 


322 








18 


602 


482 


82 










19 


642 


462 












:c 


662 


562 


622 


662 


642 


462 


562 


21 


682 


442 


442 


442 


382 


342 


302 


22 


722 


502 


582 


102 








23 


722 


382 


482 


422 


402 


302 


142 



10 11 



22 



42 

207 
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Subjects 


Select 
1 


ions 
2 


3 


4 


5 


6 


7 


s 


4tn uraae 


















9£ 


Afl? 


cow 

3Z* 




502 


562 


422 


462 


122 


9 ^ 


£Q* 
DO/, 


34% 


602 


6*2 


462 


342 


322 




ZD 


/U% 


462 


/ nor 

402 


602 


602 


462 


302 




9*7 
Z / 




542 


662 


422 


702 


482 


362 


262 


z o 


/ ZA 


C/t 
JH* 


o4% 


662 


642 


422 


382 


262 




AA7 


'.Q« 


JO/o 


00% 


362 


382 


362 


10% 


£ t-Vi (?rar1o 


















T 
■L 


OOA 


52% 


602 


582 


582 


422 


42% 




2 


AA7 




A/. V 

04% 


60/. 


522 


462 


442 


30% 




/OA 




A/. 

04/. 


/Of 

oo% 


68/. 


422 


422 




A 
H 


40% 


46* 


222 












C 


t /. *y 
74% 


602 


582 


642 


56% 


422 


522 




u 


wA 


54>. 


542 


682 


602 


422 


462 




7 


7G.£ 


45*, 


362 


542 


482 


18% 






Q 
O 


50 A 


242 


142 












Q 
.7 


dZa 


402 


/ r\ me 

422 


502 


422 


28% 


262 


10% 


i n 

JLU 


JZ% 


542 


282 


582 


422 


30% 






1 1 


TO* 

/2Z 


6G2 


642 


622 


582 


382 


422 




12 




0-+% 


56% 


10/. 










13 


662 


682 


642 


482 


532 


622 


422 


34% 


14 


702 


J*. Si 


682 


622 


50% 


282 






15 


722 


53% 


542 


462 


48% 


36% 


402 


6% 


16 


642 


622 


662 


662 


54% 


26% 







10 11 12 



32% 22% 36% 22; 
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Subjects 
6th Grade 
17 
18 
19 
20 
21 
22 
23 
24 
25 
26 
27 
23 



Selections 
1 2 



622 

78% 

66% 

74% 

70% 

64% 

68% 

72% 

62% 

74% 

68% 

62% 



48% 

48% 

46% 

46% 

54% 

44% 

40% 

56% 

56% 

64% 

66% 

48% 



54% 
6% 



42% 42% 



44% 


362 


42% 


64% 


542 


28% 


58% 


562 


52% 


52% 


50% 


362 


46% 


34% 


102 


72% 


60% 


53% 


60% 


56% 


56% 


68% 


72% 


64% 


72% 


72% 


66% 


58% 


62% 


48% 



20; 



10 



li 



12 



22% 


28% 


0% 










38% 


36% 












38% 














482 


44% 


36% 


38% 


20% 


30% 


24% 


442 


14% 












462 


462 


24% 


32% 


14% 


28% 


20% 


54% 


562 


42% 


38% 


82 






44% 


36% 


32% 


32% 









ERIC 



APPENDIX C 

MASTER LIST SCORES, MEANS, 
STANDARD DEVIATIONS FOR 
STUDENTS IN GRADES 
. FOUR AND SIX 



89 7i 



MASTER LIST OF SCORES 
For Students in Grade Four 

N = 30 



1 2 3 4 5 6 
NRT 

Compre- SRA SRA SRA r _ 

Subject hension Reading MA Language dent 



7 



Cloze Cloze cloze 
Indepen- Instruc- Frustra- 
tional tion 



1. 


5.2 


2.9 


99 


5.6 


1.5 


3.5 


4.4 


2. 


5.8 


6.6 


128 


5.8 


1.5 


3.5 


4.4 


3. 


3.8 


5.3 


104 


4.7 


1.5 


3.5 


4.4 


4. 


5.7 


4.3 


111 


6.0 


4.4 


4.8 


5.3 


5. 


5.8 


6.6 


104 


5.8 


4.4 


5.3 


6.4 


6. 


3.7 


3.8 


132 


4.8 


1.5 


2.5 


3.5 


7. 


6.3 


4.0 


128 


5.8 


.8 


2.5 


3.5 


8. 


8.2 


3.5 


117 


7.0 


.5 


1.5 


2.5 


9. 


7.2 


6.3 


141 


8.0 


1.5 


4.4 


5.3 


10. 


10.3 


7.6 


124 


7.7 


5.3 


5.8 


6.4 


1L 


4.5 


3.2 


106 


5.0 


1.5 


2.5 


3.5 


12. 


6.0 


5.6 


128 


5.8 


5.3 


6.4 


7.7 


13. 


4.0 


3.4 


111 


4.0 


2.8 


4.3 


5.2 


14. 


6.0 


5.6 


111 


5.3 


1.5 


3.5 


4.4 


15. 


5.2 


5.0 


111 


4.7 


1.5 


4.4 


5.3 
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MASTER LIST OF SCORES 

For Students in Grade Four 



(Continued) 



Subject 


1 

Compre- 
hension 


SRA 
Reading 


SRA 
MS 


4 

SRA 
Language 


5 

Cloze 
Indepen- 
dent 


6 

Cloze 

Tnsf rnr- 

tional 


7 

Cloze 
r i Uo tra 
tion 


16 




/ .0 


ion 

137 


7.1 


5.3 


7.7 


8.5 


17 


7 fi 


/ * 0 


1 1 A 

114 


6.3 


5.3 


6.4 


7.7 


18. 




O . J 


15 1 


6 . 4 


4.4 


4.8 


5.3 


19. 


4.0 




10b 


5.9 


4.4 


5.3 


6.4 


20 


j * I 


0 . o 




5.5 


1.5 


3.5 


4.4 


21. 




R 9 


I/O 


C 0 
3 . 0 


5.3 


6.4 


7.7 


22. 


4.0 


R Q 


1 1 A 
114 


0.2 


1.5 


3.5 


4.4 


23. 




q £ 

2 ♦ 0 


I 1 1 

II / 


c r 

b . 5 


4.4 


4.8 


5.3 


24. 


7.8 


1 R 
J • o 


11 / 


C *7 


4.4 


5.3 


6.4 


25. 


9.0 


R 9 




0 j 

y . J 


5.3 


7.7 


8.5 


26. 


4.8 


5.0 


104 


6.1 


1.5 


3.5 


4.4 


27. 


5.8 


6.3 


132 


5.8 


1.5 


3.5 


4.4 


28. 


3.3 


2.5 


104 


3.7 


0.5 


1.5 


2.5 


29. 


6.5 


5.4 


116 


6.8 


5.3 


6.4 


7.7 


30. 


4.8 


3.0 


95 


5.3 


0.5 


1.5 


2,5 



MASTER LIST OF SCORES 
For Students in Grade Six 



N = 30 



1 2 3 4 5 6 7 

NRT Cloze Cloze Cloze 

Compre- SRA SRA SRA Indepen- Instruc- Frustra- 

Subject hension Reading MA Language dent tional tion 



1. 


3.0 


5.4 


116 


4.5 


3.0 


4.0 


4.4 


2. 


5.6 


6.4 


99 


6.8 


3.4 


5.4 


6.4 


3. 


6.8 


5.3 


121 


6.1 


1.5 


3.5 


4.4 


4. 


6.3 


7.9 


113 


6.5 


1.5 


3.5 


4.4 


5. 


9.2 


7.5 


111 


8.7 


1.5 


5.3 


6.4 


6. 


6.1 


5.9 


96 


6.3 


1.5 


4.4 


5.3 


7. 


15.0 


11.0 


116 


10.9 


5.3 


7.7 


8.5 


8. . 


8.2 


6.8 


111 


6.9 


5,3 


7.7 


8.5 


9. 


8.5 


5.7 


117 


8.0 


3.5 


6.4 


7.7 


10. 


8.2 


7.5 


117 


6.9 


3.5 


4.4 


5.3 


11. 


8.9 


7,9 


123 


6.9 


5.3 


7.7 


8.5 


12. 


3.8 


7.9 


113 


4.4 


0.5 


1.5 


2.5 


13. 


8,0 


8.7 


104 


8,0 


2.5 


5.3 


6.4 


14. 


10.3 


11.5 


116 


8.7 


4.4 


6.4 


7.7 


15. 


12.5 


9.5 


134 


7.0 


5.3 


7.7 


8.5 
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MASTER LIST OF SCORES 

For Students in Grade Four (Continued) 



1 2 3 4 5 6 7 

N5S Cloze Cloze cloze 

Compre- SRA SRA SRA Indepen- Instruc- Frustra- 
Subject hension Reading MA Language dent tional tion 

- — , . _ — — * . — _ 



16. 


6.0 


10.7 


110 

XXI/ 


fi 7 


"} A 

J . 4 


* ^ A 


C A 

6.4 


17. 


6.3 


7.9 


113 

X X «J 


7 1 

/ • X 


C 
• J 


A A 


5 . 3 


18. 


8.7 


6.1 


111 

JL -i. X 


6 7 


4 A 

4 • 4 


J . J 




19. 


6.1 


9.5 


121 


7 1 

t * X 


4 . 4 


j • j 


C A 


20. 


11.0 


8.7 


114 

J* dm *I 


9 9 


A A 

4 . 4 


7 7 


o c 


21. 


10.5 


7.9 


113 

•X* -A* +mf 


6 3 


4 A 
4 . 4 


J ♦ J 


b • 4 


22. 


10. 3 


6 5 




J * J 


1 £ 




3.5 


23. 


15.0 


10.7 


121 


11.8 


5.3 


7.7 


8.5 


24. 


8.0 


9.5 


131 


7.5 


3.5 


5.3 


6.4 


25. 


10.3 


7.5 


110 


7.8 


5.3 


6.4 


7.7 


26. 


6.1 


5.8 


95 


6.7 


1.5 


4.4 


5.3 


27. 


9.2 


7.9 


116 


8.5 


6.4 


7.7 


8.5 


28. 


6.8 


6.3 


127 


7.1 


4.4 


5.3 


7.7 


29. 


9.4 


6.6 


95 


6.5 


.5 


2.5 


3.5 


30. 


8.9 


12.1 


123 


8.1 


5.3 


7.7 


8.5 
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